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DETAILED ACTION 
Continued Examination Under 37 CFR LI 14 

1 . A request for continued examination under 37 CFR 1.114, including the fee set forth in 
37 CFR 1.17(e), was filed in this application after final rejection. Since this application is 
eligible for continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 1 . 1 7(e) 
has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 
37 CFR 1.114. Applicant's submission filed on 10/27/04 has been entered. 



Response to Amendment 

2, The amendment received on 10/27/04 has been entered. Claims 1-36 remain pending. 



Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

4. Claims 1-4, 14, 17, 21, 24, 25, 27, and 28 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Nichani et al. (5,673,334) in view of Ueda et al. (5,271,068). 
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Regarding claims 1 and 27, Nichani et al. ("Nichani") discloses a method comprising 
receiving a digitized image of an object 54 (Figure 4). The image includes a region of interest 
which is divided into a plurality of windows, thereby "sub-regions" (Col. 7, 36-49). Note, 
Nichani discloses the windows should be big enough to accommodate the uncertain orientation 
of the package at run time (Col. 7, 43-46). However, a conventional image-feature-position- 
based inspecting method is used to rehably inspect each window or "sub-region" (Col. 12, lines 
14-17), thereby the size of each sub-regions is small enough such that a conventional inspecting 
method can reliably inspect each of the sub-regions. Nichani also discloses training only a fine 
search tool (Col. 7, lines 16-30; Col. 8, lines 30-57) and an image- feature-position-based 
inspection tool for a respective model for each of the plurality of sub-regions (Col. 6, lines 26- 
30; Col. 9, lines 1-9), building a search tree for determining an order for inspecting the plurality 
of sub-regions (Col. 9, lines 17-21), and training a coarse alignment tool 56 (Figure 4) for the 
region of interest (Col. 5, lines 55-58) so as to enable providing at run time an approximate 
location for a root sub-region of a single search tree (Figure 7; Col. 9, lines 12-67, Col. 10, lines 
1-28). Nichani discloses constructing a minimum spanning forest constituted by a plurality of 
trees (Col. 9, lines 53-63). While Nichani does not expressly state building a single search tree, 
Nichani discloses the number of trees can be manually input (Col. 9, lines 64-67, Col. 10, lines 
1-4). Therefore, it would have been obvious to one of ordinary skill in the art at the time of the 
invention to have modified the number of search trees disclosed by Nichani to include specifying 
a single search tree because it is well known in the art and would be a matter of design choice 
depending on the number of local alignment points (Col. 9, lines 64-67, Col. 10, lines 1-4). 
Nichani does not recognize dividing the region of interest in its entirety into a plurality of non- 
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overlapping sub-regions. However, Ueda et al. ("Ueda") teaches that it is known to divide the 
region of interest 21 in its entirety into a plurality of non-overlapping sub-regions (Figure 3a; 
Col. 8, lines 4-25). Therefore, it would have been obvious to one of ordinary skill in the art at 
the time of the invention to have modified the dividing the region of interest disclosed by 
Nichani to include dividing the region of interest in its entirety into a plurality of non- 
overlapping sub-regions, as taught by Ueda, because it is a methodology routinely implemented 
in the art for inspection using template matching. 

Regarding claims 14 and 21, Nichani discloses a method and apparatus for inspecting a 
spatially distorted pattern (Abstract, hues 1-2). The arguments analogous to those presented 
above for claim 1 are applicable to claim 14. Nichani discloses a memory for storing a digitized 
image of an object (Col. 5, lines 39-43), a region divider for dividing the digitized image of a 
region of interest into a plurality of sub-regions (Col. 7, 40-43), a coarse alignment 56, a fine 
search tool (Col. 7, lines 16-30; Col. 8, lines 30-57) for locating each of the sub-regions 
sequentially in an ordered based on search tree information (Col. 4, lines 1-4), and an image- 
feature-position-based inspector for inspecting the sub-regions (Col 4, lines 28-29; Col. 9, Hnes 
1-9). 

Regarding claims 2, 17, and 24, the arguments analogous to those presented above for 
claim 1 are apphcable to claims 2, 17, and 24. Nichani discloses the size of the sub-regions 
being small enough such that a conventional inspecting method can reliably inspect each of the 
sub-regions. While Nichani does not recognize being able to approximate each of the sub- 
regions by an affine transformation, it would have been an obvious matter of design choice to 
specify the approximating the sub-regions by an affine transformation. Affine transformation is 
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well known and routinely implemented in the art for correcting geometric distortions in an 
image, as well as for adding visual effects. 

Regarding claims 3, 25, and 28, Nichani discloses establishing the order so that location 
information for located ones of the sub-regions is used to minimize a search range for 
neighboring ones of the sub-regions (Col 9, lines 13-40). 

Regarding claim 4, Nichani discloses the training of only the fine search tool for the 
respective single model for each of the plurality of non-overlapping sub-regions is performed by 
using a correlation search (Col. 7, lines 15-20). 

5. Claims 6, 8, 10, 16, 23, 29, and 30 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Nichani et al (5,673,334) in view of Ueda et al (5,271,068) in further view of 
Companion et al. (6,330,354), 

Regarding claim 6, Nichani discloses a method for inspecting a spatially distorted pattern 
(Col, 3, lines 65-67). The method comprises running a coarse alignment tool to approximately 
locate the spatially distorted pattern within a region of interest (Col 1 1, lines 9-1 1) so as to 
provide an approximate location for a root sub-region of a single search tree (Figure 7; Col 9, 
lines 12-67, Col 10, lines 1-28), running only a fine alignment tool in an order according to the 
single search tree and using the approximate location of the root sub-region to locate a plurality 
of sub-regions within the region of interest so as to provide fine location information (Col 7, 
lines 16-30; Col. 8, lines 30-57; Col 9, lines 12-67, Col 10, lines 1-63; Col. 12, lines 25-67, Col 
13, lines 1-36). Note, Nichani discloses the windows should be big enough to accommodate the 
uncertain orientation of the package at run time (Col 7, 43-46). However, a conventional image- 
based inspecting method is used to reliably inspect each window or "sub-region" (Col 12, lines 
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14-17) using respective models (Col 6, lines 26-30), thereby the size of each sub-regions is 
small enough such that a conventional inspecting method can reliably inspect each of the sub- 
regions using respective models. The arguments analogous to those presented above for claim 1 
are applicable to claim 6. Ueda discloses producing a degree of resemblance for each of the sub- 
regions (Col 8, lines 16-25), but does not disclose producing a difference image. However, 
Companion et al. ("Companion") teaches that it is known to produce a difference image 
(Abstract), Therefore, it would have been obvious to one of ordinary skill in the art at the time 
of the invention to have modified the template matching disclosed by Nichani and Ueda to 
include producing a difference image, as taught by Companion, because it is a methodology 
routinely implemented in the art in order emphasize the sub-region*s deviation from the template 
to facilitate the inspection. 

Regarding claim 29, the arguments analogous to those presented above for claims 6 and 
27 are applicable to claim 29. 

Regarding claims 8, 16, 23, and 30, Nichani discloses inspecting each of the sub-regions 
using the fine location information and the image-feature-position-based inspecting method (Col. 
13, lines 40-57). Nichani does not appear to specify producing both a difference image and a 
match image. However, Ueda discloses producing a correlation for each non-overlapping sub- 
region (Col 8, lines 16-39). Companion teaches that it is known to produce a difference image 
for each of the sub-regions (Col. 5, lines 1-7). Companion also teaches that it is known to 
combine the difference images into a single difference image (Col. 6, lines 10-12). Therefore, it 
would have been obvious to one of ordinary skill in the art to have modified the inspection as 
disclosed by Nichani to include producing and combining difference images, as taught by 
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Companion, as well as match images, as taught by Ueda, because it is well known in the art of 
template matching in order to further inspect each sub-region. 

Regarding claim 10, the arguments analogous to those presented above for claim 2 are 
appUcable to claim 10. 

6. Claims 34-36 are rejected under 35 U.S.C. 103(a) as being unpatentable over Nichani et 
al. (5,673,334) in view of Ueda et al. (5,271,068) and in further view of He et al (6,088,482). 

Regarding claims 34-36, the arguments analogous to those presented above for claim 6 
are applicable to claims 34-36. Nichani and Ueda do not appear to disclose combining all 
location information to produce a distortion vector field. However, He et al. ("He") teaches that 
it is known to compare location information with model location information so as to provide a 
distortion vector and to combine all location information to produce a distortion vector field for 
each sub-region (Figure 10; Col. 12, lines 33-39). He also teaches that it is knov^n to allow for 
pass/fail decisions based on user-specified tolerances (Col. 7, lines 46-48). Therefore, it would 
have been obvious to one of ordinary skill in the art at the time of the invention to have modified 
the location information disclosed by Nichani and Ueda to include producing a distortion vector 
field as taught by He because it allows for the correction of spatial distortions (Col. 5, lines 21- 
23). 

7. Claims 5 and 20 are rejected under 35 U.S.C. 103(a) as being unpatentable over Nichani 
et al. (5,673,334) and Ueda et al (5,271,068) as appHed to claims 1 and 14 above, and further in 
view of Aiyer et al. (5,777,729). 

Regarding claims 5 and 20, Nichani discloses training the image-feature-position-based 
inspection tool for the respective model for each of the sub-regions (Col. 6, lines 26-30; Col. 9, 
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lines 1-9), Nichani and Ueda do not disclose performing the training by using a golden template 
comparison method. However, Aiyer et al. (" Aiyer") teaches that it is known to train the 
inspection tool for the respective model for each of the plurality of sub-regions performed by 
using a golden template comparison method (Col 7, lines 64-67 and Col. 8, lines 1-11). 
Therefore, it would have been obvious to one of ordinary skill in the art at the time of the 
invention to have modified the training of the inspection tool disclosed by Nichani and Ueda to 
use the golden template comparison method, as taught by Aiyer, in order to provide more 
effective training. 

8. Claims 7, 9, and 31 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Nichani et al. (5,673,334), Ueda et al (5,271,068), and Companion et al. (6,330,354) as applied 
to claims 6 and 27 above, and further in view of He et al. (6,088,482). 

Regarding claims 7 and 31, the arguments analogous to those presented above for claim 
34 are applicable to claims 7 and 31. 

Regarding claim 9, the arguments analogous to those presented above for claim 34 are 
applicable to claim 9. Ueda discloses producing a correlation for each sub-region (Col. 8, lines 
16-39). Companion teaches that it is known to produce a difference image for each of the sub- 
regions (Col, 5, lines 1-7). Companion also teaches that it is known to combine the difference 
images into a single difference image (Col 6, lines 10-12). Therefore, it would have been 
obvious to one of ordinary skill in the art to have modified the inspection as disclosed by Nichani 
to include producing and combining difference images, as taught by Companion, as well as 
match images, as taught by Ueda, because it is well known in the art of template matching in 
order to further inspect each sub-region. 
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9- Claim 1 1 is rejected under 35 U.S.C. 103(a) as being unpatentable over Nichani et al. 
(5,673,334), Ueda et al. (5,271,068), and Companion et al. (6,330,354) as applied to claim 6 
above, and further in view of Miyake (6,009,213). 

Regarding claims 11, Nichani discloses inspecting each of the sub-regions (Col. 13, lines 
53-54). Nichani does not recognize using location information from located ones of sub-regions 
to interpolate location information for a sub-region when the sub-region cannot be located. 
However, Miyake teaches that it is known to use interpolation based on location information for 
a sub-region (Col. 5, lines 62-65), as broadly as claimed. Therefore, it would have been obvious 
to one of ordinary skill in the art at the time of the invention to have modified the inspection 
method disclosed by Nichani, Ueda, and Companion to include interpolation based on location 
information, as taught by Miyake, and then use the interpolated location information to inspect 
the sub-region in order to inspect sub-regions that cannot be located. 

10. Claim 12 is rejected under 35 U.S.C. 103(a) as being unpatentable over Nichani et al. 
(5,673,334), Ueda et al. (5,271,068), and Companion et al (6,330,354) as apphed to claim 6 
above, and further in view Dance et al (6,285,799). 

Regarding claim 12, Nichani discloses training a search tool and an inspection tool for a 
respective model for each of sub-regions (Col 6, lines 26-30). Nichani does not recognize using 
the respective models for some of the sub-regions to determine respective fine location 
information. However, Dance et al ("Dance") teaches that it is known to determine location 
information (Col 9, lines 63-64). Dance also teaches that it is known to predict fine location 
information using the respective location information (Col. 9, lines 63-65). Therefore, it would 
have been obvious to one of ordinary skill in the art at the time of the invention to have modified 
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the training method disclosed by Nichani, Ueda, and Companion to include determining location 
information and predicting location information, as taught by Dance, in order to correct blurred 
images recorded by digital cameras (Col. 3, lines 6-17) and thereby compensate for training that 
was not successfully performed on a sub-region. 

11. Claim 13 is rejected under 35 U.S.C. 103(a) as being unpatentable over Nichani et al 
(5,673,334), Ueda et al. (5,271,068), and Companion et al. (6,330,354) as apphed to claim 6 
above, and further in view Aiyer et al. (5,777,729). 

Regarding claim 13, the arguments analogous to those presented above for claim 5 are 
applicable to claim 13. 

12. Claim 33 is rejected under 35 U.S.C. 103(a) as being unpatentable over Nichani et al. 
(5,673,334), Ueda et al (5,271,068), and Companion et al (6,330,354) as apphed to claim 6 
above, and further in view Clark et al. (6,370,197). 

Regarding claim 33, Nichani discloses using a search tool to locate the plurality of sub- 
regions (Col. 9, lines 17-21). Nichani does not disclose dividing the sub-regions into smaller 
sub-regions when one of the sub-regions cannot be located. However, Clark et al. (''Clark") 
teaches that it is known to further sub-divide a block or "sub-region" when a condition is not met 
after inspection of the sub-region (Abstract, lines 2-7). Therefore, it would have been obvious to 
one of ordinary skill in the art to have modified the fine search tool disclosed by Nichani, Ueda, 
and Companion to include dividing one of the non-overlapping sub-regions into a plurality of 
smaller sub-regions when the one of the sub-regions cannot be located during the use of the 
search tree information by applying Clark's teaching to further sub-divide a sub-region when a 
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condition is not met, in order to locate the sub-region that could not be located by the search tree 
information. 

13. Claims 15 and 22 are rejected under 35 U.S. C. 103(a) as being unpatentable over Nichani 
et al. (5,673,334) and Ueda et al. (5,271,068) as applied to claims 14 and 21 above, and further in 
view of He et al (6,088,482). 

Regarding claims 15 and 22, the arguments analogous to those presented above for claim 
7 are applicable to claims 15 and 22. 

14. Claims 18, 26, and 32 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Nichani et al (5,673,334) and Ueda et al. (5,271,068) as applied to claims 14, 21, and 27 above, 
and further in view of Miyake (6,009,213). 

Regarding claims 18, 26, and 32, the arguments analogous to those presented above for 
claim 1 1 are apphcable to claims 18, 26, and 32. 

15. Claim 19 is rejected under 35 U.S.C. 103(a) as being unpatentable over Nichani et al. 
(5,673,334) and Ueda et al. (5,271,068) as appHed to claim 14 above, and further in view Dance 
et al. (6,285,799), 

Regarding claim 19, the arguments analogous to those presented above for claim 12 are 
applicable to claim 19. 
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Response to Arguments 

16. Applicant's arguments filed 10/27/04 have been fully considered but they are not 
persuasive. 

Summary of Applicant's Argument: Nichani does not disclose an image-feature- 
position-based inspection method such as Golden Template Analysis, or Patlnspect, as taught by 
the Applicant, Nichani teaches away from using a single search tree. Ueda is silent on what size 
each of the sub-regions must be and provides no method for reducing the size of the sub-regions 
so as to ensure rehable character recognition. Applicant's invention uses only a fine search tool 
to search within a plurality of non-overlapping sub-regions whereas Nichani uses a coarse 
alignment tool to search a plurality of windows. Nichani teaches away from combination with 
Companion. 

Examiner's Response: Nichani discloses an image-feature-position-based inspection 
method (Col. 5, lines 23-34, 49-54; Col 6, lines 9-21; Col. 9, lines 1-9; Col. 11, lines 6-46; and 
Col. 13, Hues 40-67, Col, 14, lines 1-35), as broadly as claimed. While Nichani does not 
disclose an inspection method such as Golden Template Analysis or Patlnspect, Nichani 
discloses an inspection method based on the position of the check boxes in an image (Col. 9, 
lines 1-9). Nichani does not teach away from using a single search tree. Nichani discloses a 
single search tree in Figure 7. The number of trees would be a matter of design choice 
depending on the number of alignment points. Ueda expressly discloses dividing a region of 
interest in its entirety into a plurality of non-overlapping sub-regions (Figure 3a; Col. 9, lines 34- 
63) such that a conventional inspecting method can reliable inspect each of the sub-regions. As 
noted by the Applicant (Page 25, para. 2), Ueda states that the subregions are formed so that 
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adjacent subregions overlap (Col 3, lines 24-25). However, Ueda discloses that the subregions 
are further subdivided into a plurality of non-overlapping parts (Col. 9, lines 34-63). Therefore, 
the subregion 21 (Figure 3a) disclosed by Ueda is the region of interest that is divided in its 
entirety into a plurality of non-overlapping sub-regions as shown in Figure 3 a. Nichani discloses 
training only a fine search tool (Col 7, lines 16-30; Col, 8, lines 30-57). As indicated above, 
Nichani discloses an image- feature-position-based inspection method (Col. 13, lines 40-67, Col. 
14, lines 1-35). Companion discloses an image-based inspection method (Abstract). Nichani 
and Companion are combinable because they are from the same field of endeavor. 



Contact Information 

17. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Virginia M Kibler whose telephone number is (703) 306-4072. 
The examiner can normally be reached on Mon-Thurs 8:00 - 5:30 and every other Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Amelia Au can be reached on (703) 308-6604. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 
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Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 



Virginia Kibler 
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